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1 . INTRODUCTION 

Even  though  experimental  design  has  been  widely  studied  in  statistical 
literature,  only  in  the  last  fifteen  years  the  selection  of  an  optimal  input 
and  measurement  schedules  for  parameters  estimation  of  dynamic  systems  came 
into  full  attention. 

Since  the  papers  by  Levin  [1],  Levadi  [2]  and  Nahi  and  Wallis  [3], 
an  increasing  number  of  works  has  been  devoted  to  the  input  design  for 
identification  purposes  (see  [4]  for  a survey).  In  [4]  and  [5],  Mehra 
contributes  a first  systematic  view  of  this  subject  by  properly  extending 
to  dynamic  systems  the  optimal  experiments  approach  suggested  by  Fedorov 
for  regression  problems  [6],  In  most  cases,  the  problem  has  been  faced  as 
an  optimal  control  problem  with  a suitable  norm  of  the  Fisher  Information 
Matrix  as  performance  index.  The  motivation  underlying  this  approach  is 
twofold:  first,  the  evaluation  of  the  convariance  matrix  of  a given 

estimator  is  often  a difficult  task;  second,  the  interest  in  the  conclusion 
which  can  be  drawn  through  the  analysis  of  this  covariance  matrix  is 
obviously  restricted  to  the  particular  kind  of  estimators  under  consideration. 
Therefore,  it  is  generally  assumed  that  an  efficient  estimator  exists  and 
the  problem  of  designing  an  input  in  order  to  maximize  a norm  of  the  Fisher 
Information  Matrix  is  directly  faced. 

Strangely  enough,  the  measurement  schedules  design  has  not  been  paid 
an  equally  extensive  attention  as  the  input  design  problem.  Considerable 
results  concerning  both  the  measurement  schedules  and  the  sensor  design 
problems  have  been  recently  pointed  out  in  [7]  for  state  estimation  purposes. 
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This  paper  mainly  deals  with  the  problem  of  jointly  optimizing  the  input 
and  measurement  schedules  for  parameters  estimation  under  system  periodic 
operation.  Actually,  although  the  analysis  of  a number  of  periodic  regimes 
of  a system  is  a classical  tool  for  the  better  understanding  of  its  dynamic, 
only  in  the  last  few  years  it  has  been  possible  to  provide  some  results 
concerning  the  input  design  in  the  frequency  dom  in  (see,  for  instance, 

[4],  [8]  - [10]).  The  present  paper  deals  with  time-invariant  discrete-time 
dynamic  systems  and  is  organized  as  follows.  First,  a number  of  problems, 
namely,  the  optimal  periodic  input  design,  the  joint  optimal  periodic  input 
and  measurement  schedules  design  and  the  choice  of  the  best 
period  are  stated  in  a precise  formal  way  (Section  2).  By  introducing  the 
average  per  sample  Fisher  Information  Matrix,  they  are  readily  recognized 
(Section  3)  to  fall  within  the  area  of  Periodic  Optimization  Theory.  (See 
[11]  - [13]  for  recent  surveys  on  the  subject  and  [14]  for  the  specific 
tools  in  the  discrete  systems  case).  The  particular  case  of  linear  systems 
affected  by  a scalar  parameter  is  dealt  with  in  Sections  4-6,  where  a 
closed  form  solution  is  found  for  most  of  the  problems  mentioned  above. 

2 . Problem  Statement 

Consider  the  discrete-time  and  time-invariant  dynamic  system 

x(k+l)  = f (x(k) ,u(k) ,0)  (1) 

y (k)  - g(x(k),u(k),9)  (2) 

with  initial  condition 

x (0)  - x (9), 
o 


(3) 


- 3 - 

where  u(k)  < R™,  x(k)  t R°,  y(k)  ( RP  are  the  input,  state  and  output  vectors, 
while  0 ( R*1  is  the  unknown  parameters  vector.  The  functions 
g(.,.,.)  and  xq(')  ate  assumed  to  be  continuously  differentiable  with  re- 
spect to  their  arguments  and  u(-)  is  regarded  as  a deterministic  signal. 
Denoting  by  y(k,u(*),  xo(0),0)  the  solution  of  (1)  - (3)  and  by  w(*)  a p- 
dimensional  zero-mean  white  gaussian  process  with  positive  definite  covariance 
matrix,  viz, 

E[w(h)w'(k)]  = R 6 (h-k) , R > 0 (l) 

!0,  r^O 

' 

1,  r=0. 


assume  that  the  measured  output  z(-)  is  given  by 
z(k)  = y(k,u(‘) ,xq(0) ,9)  + w(k) 
where  0 is  the  "true"  value  of  the  parameters  vector. 

Then,  it  is  well  known  [15]  that  the  Fisher  Information  Matrix  can  be 
usefully  written  as  a function  of  the  output  sensitivity  coefficients  (see 
the  pioneer  work  of  Slepian  [16]  for  the  non-dynamic  case).  More  precisely, 
denoting  by  .5 f any  discrete  time  set  In  which  output  observations  may 
be  performed  and  letting  ' 


n^k.uO)  ,*o(0)  »0) 


3 

30, 


y(k,u(‘) ,Xq(0,) ,0) 


(1) 


Given  two  square  matrices  H and  K of  the  same  order,  H>K[H>K]  means  that 
H-K  is  a semi-definite  [definite]  positive  matrix. 
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n(k,u(- ) ,xQ(e) ,0)  = I n1(k,u(') ,xQ(0) ,0)  [n2(k,u( •) .x2(0) ,0)  j 


. . i n^(k,u(0  , XQ (0 ) ,0)  | , 


(4) 


the  covariance  matrix  C of  any  unbiased  parameters  estimator  with  measure- 


ment schedules  . ' 'V  satisfies  the  inequality 
-1 


C >_.«  ( //\e,u(-)) 


(5) 


where 


U (JT,Q,u(‘))  = Jk(  n'(k,u(-),  xq(0),0)R  1 n(k,u(.) ,xo(0) ,0) 

(6) 


is  the  so  called  Fisher  Information  Matrix  (if  q=l , (5)  becomes  the 

celebrated  Frechet-Cramer-Rao  inequality  [17]).  Note  that  vector  (4)  can 

be  regarded  as  the  output  of  the  sensitivity  system  associated  to  (1) , 

(2),  i.e.  as  the  output  of  the  (q+1)  n -th  order  system 

x(k+l)  = f (x(k) ,u(k) ,0)  (7) 

o . (k+1)  = f (x(k),u(k),0)o  (k)  + ffl  (x(k) ,u(k) ,0) , 
i x ^ ^ i. 

i-1 ,2 , . . . , q (8) 

n± (k)  = gx(x(k) ,u(k) ,0)o1(k)  + gg  (x(k) ,u(k) ,0) , 

1-1,2,. ...q  (9) 


subject  to  the  initial  condition 
x(0)  = xq(0) 

a (Ol  * rjr-  x (0),  1-1,2,... ,q.  (11) 

i do  . O 


Since,  in  this  paper,  only  the  periodic  regimes  of  system  (1),  (2)  are  taken 
into  consideration,  condition  (10)  must  be  replaced  by 
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x(0 ,9)  = x(N,9)  (12) 

where  the  period  N is  any  positive  integer;  correspondingly,  constraint 
(11)  takes  on  the  form 

oi(0,6)  = o1(N,0),  i=l,2,...,q.  (13) 

Denoting  by  n(N,-,9)  the  periodic  extension  of  the  solution  of  system  (7)- 
(9)  under  the  periodicity  constraints  (12),  (13)  and  by  .//  (N,  if  ,9,u(- )) 
the  corresponding  Fisher  Information  Matrix,  (6)  implies  that 

.M  (N,  if  ,9,u(*))  = Ikf^n'(N,k,9)R"1n(N,k,9)  (14) 

and  inequality  (5)  becomes 

C > ,^_1(N,  if  »9,u( * ))  , (15) 

where  C is  the  covariance  matrix  of  any  unbiased  estimator  based  on  N- 
periodic  regimes  data  corresponding  to  the  measurement  schedules  set  f . 

In  dealing  with  the  input  and  measurement  schedules  design  problem 
on  the  basis  of  the  Fisher  Information  Matrix  analysis,  a main  problem 
arises  in  connection  with  the  necessity  to  evaluate  this  matrix  at  the 
(unknown)  "true"  value  9 of  the  parameters  vector  in  order  that  (15)  holds. 
To  circumvent  this  difficulty,  two  approaches  have  been  proposed  in  the 
literature;  the  first  one  consists  in  assuming  that  an  a priori  probability 
distribution  h("):  R^  -*■  R'*'  for  the  parameters  vector  9 is  given  (Bayesian 

approach);  the  second  one  consists  in  admitting  that  a "nominal"  value 
9 of  9 is  available  (see  [3],  [4]  and  [18]  for  a more  detailed  discussion). 
In  order  to  apply  the  latter  approach  to  the  problem  considered  here,  the 
following  result  is  needed,  the  proof  of  which  is  omitted  as  a straight- 
forward estention  to  the  discrete-time  case  of  the  proof  given  in  ([19], 
page  253). 
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Proposition  1 : 
If 


(1)  system  (1)  admits  a unique  N-periodic  solution  5t(N,.,9)  corresponding 
to  the  value  0 = 0 of  the  parameters  vector 
(ii)  the  linear  N-periodic  system 

6x (k+1)  = fx(x(N,k,0),u(k),0)6x(k) 
admits  no  N-periodic  solution  other  than  the  trivial  one,  i.e.  the 
corresponding  monodromy  matrix  has  no  eigenvalue  equal  to  one, 
then  there  exists  a neighborhood  Q of  0 such  that,  for  any  any 
0(  system  (1)  admits  one  and  only  one  N-periodic  solution  x(N,.,9),  given 
by 

Q 

x(N,k,0)  = x(N,k,0)  + l a ( N,k,9}<50,  + o(60) 

l1  1 

where  {o  (N,.,9),  i=l ,2 , . . . ,q , }is  the  unique  N-periodic  solution  of  (7), 
(8);  60  { ^ 0t  - Q{  and 


11m 

| 1 60 1 |-+0 


!l«e|| 


o • 


□ 


Roughly,  this  proposition  says  that,  if  0 f 0,  it  makes  sense  to  consider 
.At  (N,  .‘7’,  9,  u(«))  as  a fair  approximation  of  .At  ( N,  & , 6,  u(  . ))  . In  this 
connection,  it  is  worthwhile  to  note  that  a similar  expression  of  the 
Fisher  Information  Matrix  has  been  derived  in  [A] , with  9 playing  the 
role  of  the  mean  of  the  a priori  distribution  of  9 (Bayesian  approach) , 
while,  in  [18],  a rather  obvious  iterative  procedure  is  recommended  for 
the  approximation  of  .At  ( 0,  u(  . ) ) . 
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Denoting  by  R+  the  non-negative  real  numbers,  let  p [ • ] : R^X^-*-R+  be 

a suitable  mapping  such  that  p[.//(N,  //'  ,0,u(.))]  characterizes,  in  a 
scalar  form,  the  "magnitude"  of. U (N,  //' ,Q,u( . ) ) (for  a discussion  about 
some  of  the  possible  choices  of  p [ • ] , see,  for  instance,  [6]).  Then,  the 
above  considerations  lead  to  the  problem  of  maximizing 

L(N , //\u(.)  = p^/7(N,  //\0,u(-)l  (16) 

under  some  input  constraint  u(-)  f 0,  where  ft  is  a suitably  specified 
function  set,  e.g. 

A N-l 

ft  = (uC):  lk  V(u(k))  < c}  (17) 

o 

where  c>o  is  given  as  well  as  the  non-negative  function  v(-)< 

The  analysis  of  the  performance  index  (16)  suggests  to  take  into 
consideration  the  following  problems  as  particularly  significant.  Let 
y be  the  integers,  the  positive  integers,  .?(•)  the  power  set  and 


Problem  A (Optimal  Input  Design) 

For  a given  N < ?'+  and  .'/(  y) , find  u (•)  c ft  such  that 

l(n,  ar  ,u  (•))  > l(n,  <r  ,u(*) ) vu(-)  c n 

o - 

Problem  B (Optimal  Input  and  Period  Design) 

For  a given  ,rf  c find  N ^ and  f ft  such  that 

L(Sel u£))  > L(N,  ,u(-)),  V(N,u(-))<  J+xft  . 

Projilem^  C (Optimal  Input  and  Measurement  Allocation  Design) 

For  a given  pair  (N,v)  f x find  .9’^  (■  and  u^(-)  ( SI  such  that 


8 


LfN.'/^u^.))  > V(//\u(.))  < ^(J)xn. 


Since  the  computational  complexity  of  the  parameter  estimator  strongly 
depends  on  the  cardinality  of  if  , it  is  obvious  that  a first  meaningful 
choice  of  a good  menasurement  schedule  set  is  among  "computationally 
equivalent  sets",  namely  sets  of  given  cardinality  (Problem  C) . In 
order  to  state  in  a consistent  way  a more  general  optimal  measurement 
schedule  design  problem  it  is  necessary  to  introduce  a suitable  measure 
of  the  obtainable  information  per  unit  of  computational  effort. 

/ 

Problem  D (Optimal  Input  and  Measurement  Schedule  Design) 

For  a given  N ( j + , find  if^  ( and  u^(.)  ( 0 such  that 


□ 


~ — L ( N , if, , u , ( . ) ) “ — L(N  , u(  . ) ) , V( 

\y6\  * * -\&\ 


where  j.j  denotes  the  cardinality.  j— ^ 

The  analysis  of  Problem  D directly  leads  to  the  introduction  of  an  average 
per  sample  Fisher  Information  Matrix  and  constitutes  the  subject  of  the 
next  Section  3. 

Finally,  the  formal  statement  of  an  optimal  input,  measurement  schedule 
and  period  design  problem  is  omitted  as  trivial. 

3 . AVERAGE  PER  SAMPLE  FISHER  INFORMATION  MATRIX  UNDER  PERIODIC  OPERATION 
Considering  any  finite  measurement  schedule  if , the  average  per  sample 


Fisher  Information  Matrix  under  periodic  operation  is  defined  as  follows: 
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M(N , ^,u(-))  = J—J  . "(N,  //’  ,0,u(.))  (18) 

(in  [A],  under  stability  assumptions  - here  not  necessary  - the  terminology 
"asymptotic  per  sample  Fisher  Information  Matrix"  is  adopted).  In  analogy 
with  (16),  the  scalar 

J(N , ^,u(-))  = p[M(N,^,u(*))]  (19) 

is  associated  to  matrix  (19). 

Letting 

Sv,  = [0,  N-l ] 

n.  (P)  = {k  : k-jNeP  | Pf.f(sfJ) , uj) 

.SiJ)  = Qj  (p)  } | Pt.^(fN),  J €#(£")}  <20) 

in  this  section,  the  families  of  matrices 

,yc  = {M(N,  $P ,u('))  | & f .^(sM)} 

.y  = (M(N,.y',u(-))  | ,y < ? ) } 

y = {m(n , /y.uo)  | ,rc  .y(^)} 

and  the  corresponding  sets  of  scalars  given  by  (19)  are  usefully  compared. 
Given  h ( ^ and  a measurement  schedule  if  < iff.#),  denote  by 

.'Sh  =/yn[hN,  (h+l)N-l] 

H - {h|^h^}. 

Then,  the  following  preliminary  result  can  be  stated. 

Proposition  2 

The  average  per  sample  Fisher  Information  Matrix  corresponding  to  any 
measurement  schedule  If  ( ■f(J')  can  be  given  the  form 
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M(N 


r I m 

■ K < H 7^7  M(N’ 


(21) 


Proof : 


Equations  (14)  and  (18)  immediately  imply  (21). 

□ 

Noticing  that  ./  is  a finite  set,  denote  by  y its  cardinality  and  by 


C"l'/S  1 ■ ' \i  “iKilKlt  , v‘-‘'2 

N 1 N 

X 

b 


A 

oi  ( R+,  Vi=l,2, . . . , xi  Jj  0(^=1} 


its  convex  hull;  furthermore,  let 

U = ( ^ | 0 < a < N;  b > N;  (a.b)  ( Jx/  } 


and  define 


CW[  .^s  1 = { l±  w.  Kt  | Kt  f JT,  , Vi=l  ,2 XJ 


w f W,  Vl=l,2,...,x;  l w = 1). 

I1  1 


Corollary  1 


For  a given  pair  (N,u(*))  f ^ xSl,  it  is 


& * cw[.^s  ], 

N 


and 


(22) 


(23) 


Proof 


Let 


■<?h  - (k  f SN|  k (mod  N)  f //  }. 


1 1 


Then,  in  view  of  the  periodicity  of  n(N,.,§),  Eq.  (21)  can  be  written  as 
follows 


M(N, //\u(-»  = l 

Hf"  | </ 


M(N,  ^h,u(-)). 


so  that  the  first  part  of  the  Corollary  easily  follows. 

As  for  the  second  part,  noticing  that,  if  if  < .fi?),  then  ,f.  = if , , 

hl  h 2 

Vfh^.h^)  ( HxH,  Eq.  (24)  implies  that 


Since  the  converse  of  this  inclusion  is  trivial,  statement  (23)  is  proved. 
Theorem  1 

For  a given  pair  (N,u(*))  C ?+ xQ,  the  maximum  of  J (N , •V’,u( • ) ) with  respect 
to  ifc.fi?)  exists  and  is  given  by 

max  ^ J(N,  .y'.uf* ) ) = max  J(N,  if,ui- ))  . (25) 

if  C .fi?)  .fl.fi sN) 

Furthermore,  if  y [ * 1 is  a convex  mapping  (in  particular  a matrix  norm), 
the  maximum  of  J(N,  ,'/’,u(’ ))  with  respect  to  if  c ifi?)  exists  and  is 
given  by 

max  J(N,  ff,u(‘  ))  = max  J(N,.9p,u('))- 

ifC.fi?)  .fc.fi  sN) 

Proof 

Since  .i^(SN)  is  a finite  set,  the  maximum  of  J (N , if,ui • ) ) with  respect  to 
if  C .^(S^)  exists.  From  the  obvious  equalities 
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max  J (N , ) ) = max  g[K] 

.</>  f ) K( 

N SN 


(26) 


max  J(N,^,u(*))  = max  p[K], 

& € .-?(  ? ) K C .T 

statement  (23)  Immediately  imply  equality  (25).  If  p [ • ] is  a convex  mapping, 
the  maximum  of  u [ * ] over  the  polyhedral  convex  set  ] exists  and 


is  given  by 


max 

Kt  CH[  ] 
N 


p [K]  = max  p[K] . 


(27) 


K C 


Then,  the  trivial  inclusions 


,rs  C CWf  ,ys  ] c CHf  JT  ), 

N N N 

together  with  equality  (27),  implies  that  the  maximum  of  p[.]  over  CW[  ] 

N 

exists  too  and  is  given  by 


max 

K € CW[  Ss  ] 
N 


p [K]  = max  p [K] . 


(28) 


K € 


N 


From  (22)  and  (26)  - (28),  the  second  part  of  the  theorem  follows. 

The  above  results  suggest  to  replace  Problems  A,  B,  D with  the  follow- 
ing problems,  which  are  stated  in  much  simpler  terms  by  making  reference 
to  the  time  interval  [0,  N-l]  only. 

Problem  A 

For  a given  N c ^ and  ^"(.^(S^),  find  u°(') ( ft  such  that 
J(N,  •T’.uV))  > J(N,  .^,u(.)),  Vu(  • ) eft. 
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Problem  B 

For  a given  If  ( ,^(S  ),  find  N°  f and  u®(*>£  ft  such  that 

N " 

J(N^,.'/,uY))  iJ(N,.r/,u(-)),  V(N , u(  • ) ) £ ^xft. 

Problem  D 

For  a given  N £ J'+,  find  If  £ ,f(S)  and  u^(-)  £ fi  such  that 
<7  N 

J(N,.r/,uV))  > J(N,^u(')),  V(//>(-))  £ ^(Sjxft  . 

N □ 

From  a conceptual  point  of  view,  it  is  worthwhile  to  define  also  the 
following  problem. 

Problem  C 

For  a given  N £ J'+  and  v £ [1,N],  find  ,f  ^ (S„)  and  u^(-) c ft  such  that 

^ V N 

However,  note  that  it  is  mainly  the  knowledge  of  the  solution  of  Problem  D 
which  does  provide  useful  indications  for  the  search  of  the  solution  of 
Problem  C. 

Problems  A - D are  suited  to  be  faced  by  general  Periodic  Optimiza- 
tion techniques  (see,  for  instance,  [14]);  however,  it  is  only  in  the 
particularly  important  case  of  linear  systems  that  these  problems  can 
actually  be  worked  our  further  up  to  obtain  results  which  can  eventually 
be  exploited  in  a simple  and  more  direct  way.  In  order  to  illustrate 
this  point,  the  remainder  of  the  paper  is  entirely  devoted  to  the  analysis 
of  the  special  case  of  linear  systems  affected  by  a scalar  parameter; 
as  a matter  of  fact,  most  of  the  problems  can  in  this  case  be  given  a 
closed  form  solution. 
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4. 

OPTIMAL  INPUT  DESIGN 

Consider  system  (1),  (2)  with 

f (x(k) ,u(k) ,0)  = A(0)  x(k)  + B (0) u (k) 

(29) 

g(x(k) ,u(k) ,9)  = C(0)x(k) , 

(30) 

where  A(‘),  B(’)  and  C(*)  are  continuously  differentiable  matrices  of 
suitable  order  and  8 is  a scalar  parameter.  In  order  that,  for  each  N, 
the  corresponding  2n  -th  order  sensitivity  system  admits  a unique  N-periodic 
solution  in  a neighborhood  of  the  parameter  nominal  value  9,  it  is  assumed 
that  no  eigenvalue  of  A(0)  has  unitary  absolute  value. 

Since,  in  the  here  considered  case,  the  Fisher  Information  Matrix  is 
obviously  a (non  negative)  scalar,  inviewof  (14),  (18),  and  (19),  the  per- 
formance index  can  be  given  the  form 

J(N,.^,u(*))  = Zk(//,n'(N,k,9)  R'1n(N,k,0),  (31) 

where  if  ( :f(S  I ). 

N 

As  far  as  constraint  (17)  is  concerned,  a power-constraint  of  the  form 

jjf  Ik  ( S u'  i c (32) 

is  now  considerd,  where  Q is  any  given  positive  definite  matrix.  Without 
any  loss  of  generality,  constraint  (32)  will  be  given  the  simpler  form 

A^u'OOuOO  < 1 (33) 

In  order  to  synthetically  state  the  following  results,  some  preliminary 


notations  and  definitions  are  now  introduced. 
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Let 


G(z)  = C0(9)(zI-A(0))"1B(0) 

+ C(0)(zI-A(0))_1Ae(9)(zI-A(0))_1B(0) 
+ C(Q) (zI-A(0) ) _1B0(0) 


be  the  z-transfer  matrix  of  system  (7)  - (9),  (29),  (30)  corresponding  to 

the  parameter  nominal  value  and  II  (N be  the  following  mxm  complex 

r,s 


valued  matrix 


n (N , if)  = b (N,//)G*(exp(jr  —))  R-1G(exp(js  %), 

r | s LjS  r w 


(r,s)  ( S xS  , 
N N 


(34  ) 


where  the  scalar  b (N,.'/’)  is  given  by 
r , s 

A 1 


Vs^’^  * T^T  ^ exP (-j rk  ~)  exp(jsk  ~)  (35) 

and  * denotes  conjugate  transpose  (in  the  following,  the  trivial  case  when 

G(z)  = 0,  Vz,  is  not  considered).  Since 

n*  (N ,//■)  = II  (N,,!?’) , V(r,s)  l S xsvi 
r,s  s,r  N N 

the  mNxmN  matrix 

r(N,.y’)  - [n  (n,//)] 

r=0 , 1 , . . . , N- 1 
s=0 , 1 , . . . ,N-1 

turns  out  to  be  Hermltian. 

Finally,  consider  the  Finite  Fourier  Transform  expansion  [ 20 ] of 


(36) 


u(*) 

“00  “ ^h£S  UhexP(Jkh  <37> 

and  let 
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U*  = [U*  U*  ...  U*  ,].  (38) 

o 1 N-  L 

Theorem  2 

The  performance  Index  (31),  under  (7)  - (9),  (12),  (13),  (29),  (30)  can  be 
given  the  form 

J (N , u( • ) ) = U*r(N,^)U  (39) 

while  constraint  (33)  can  be  written  as 

U*U  £ 1.  (40) 

Proof 

When  0=9,  the  output  of  the  sensitivity  system  (7)  - (9),  (29),  (30)  under 
(12),  (13),  corresponding  to  the  input  (37)  is  given  by 

n(N,k,9)  = £h(.  G(exp(jh  ^) ) Uh  exp(jkh  ^)  (41) 

From  (31)  and  (41),  it  follows  that 


J(B..'AuC»  - Ir£S 


N " v ^ 

which  is  equivalent  to  (39);  (40)  is  direct  consequence  of  (33)  and  (37). 
Rema  rk  1 

The  matrix  F(N,//7)ls  obviously  positive  semi-definite.  Since  it  is  also 
Hermitian,  its  eigenvalues  are  all  non-negative  real  numbers.  Furthermore, 
it  can  easily  be  seen,  from  (34)  and  (35),  that 


Vr,  * "r,,<N-4">-  ,(r-s)  ( W V 9 ‘ *<V 

( — denotes  conjugate).  Therefore,  to  each  eigenvalue  A of  r(N,«SF)  it  can 
be  associated  a (non  zero)  eigenvector  U*  with  the  property 


<-h  ‘ <■ 


Vh  ( SN. 


(42) 
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The  solution  of  Problem  A can  now  be  obtained.  Let 


F(N)  " [fr,slr=0,l, 
s=0,l , 


,N-1 

,N-1 


f 

r ,s 


A , 2n . 
= expljrs  — ) 


and  denote  by 

.?  (N)  = F(N)xI 

m 

the  Kronecker  product  (see  [21],  page  227)  of  F(N)  and  the  m-th  order 

identity  matrix  I . Furthermore,  define  the  mN  vector  V/ as 
m 

V/’  = lu'(O)  u’(l)  ...  u’(N-l)]  (43) 

and  denote  by  f/°(N,if)  vector  (43)  corresponding  to  the  solution 
u°(N,.!/[-)  of  Problem  A,  where,  for  the  sake  of  notational  clarification, 
the  dependence  on  N and  if  is  explicity  pointed  out. 

Theorem  3 

Let  ’J°(N ,if)  be  a unitary  norm  eigenvector  of  r(N,.'/?)  corresponding  to 
its  maximum  eigenvalue  X [T(N ,ff)\  and  satisfying  condition  (42).  Then, 

IQ3X 

V/°(N,if)  = .JT(N)  U°(N,  if)  (44) 

and 

J (n , if, u° (n , .y,  • ) ) = x [r(N,  //)] . 

max 

Proof 

Since  HU,  if)  is  a positive  semi-definite  Hermitian  matrix,  it  is  well  known 
that  the  maximum  of  (39)  under  constraint  (40)  is  reached  when  U is  a unitary 
norm  eigenvector  of  r(N,.y7)  associated  to  its  maximum  eigenvalue.  On  the 
other  hand,  in  order  that  the  inverse  transform  V/ of  U (given  by  V/  * ,*T(N) U ) 
be  a real  vector,  it  is  necessary  and  sufficient  that  condition  (42)  is 
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satisfied  (see  Remark  1). 


□ 


As  far  as  the  particularly  significant  cases  //'=  and  if=  = {0} 
are  concerned,  the  foil  ving  results  are  easily  derived  from  Theorem  3. 

Theorem  4 (.!/’=  S..) 

N 


Let 


n(z)  = G*(z)R_1G(z) 


(45) 


2tt. 


and  denote  by  a unitary  norm  eigenvector  of  n(exp(jh  — ))  corresponding 


to  its  maximum  eigenvalue  X^.  Then,  if  h ( is  defined  as  follows 

Vh  t , 
the  optimal  input  is  given  by 

o 2tt. 


V ± V 


s/l  Re{VjO  exp(jkh°  -~) },  h°  ^ 0 (46.  a) 


u (N,  S N,k) 


0 

(Re  {.}  denotes  the  real  part  ). 
Proof 

If  if  =*  (34)  and  (35)  imply  that 


, h = 0 


(46. b) 


H (exp  ( j r ^))  , 


n ( N , S ) 

r ,s  N 


I 0 


s=r 


s^t 


Consequently,  T(N,^)  turns  out  to  be  a block  diagonal  matrix  (see  (36)),  so 
that 

^max  ^ ® ■ V 


and 
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/ -1  y'v'0y'  ...  f 'v’0  y'  ...y'}, 

»o<«,sNc  - p 

( [V  y'  y'  . . .y'  ] 


h°^0 


, h°=0. 


(47. a) 


(47. b) 


where  y is  the  m-dimensional  zero  vector  while  V,_  and  V.0  enter  (47. a)  in  the 

hu  r 

o . , . o. 


h°  'hL 

h^-th  and  (N-hu)-th  positions  respectively  (note  that  is  an  eigenvalue 


°f  n ,0  v.  .0(N,S„)  and  V.o  the  associated  unitary  norm  eigenvector).  From 
N-h  , N-n  N h 

(44)  and  (47),  the  thesis  follows. 


Theorem  5 S^) 


Let 


*(Nl 


i i 

G(exp(jO  ~^))  | G(exp(j  1 ~)  ) j 


N 


V *- 


H (N)  = Z$(N) 

and  denote  by  h^(N)  the  i-th  row  of  H(N).  Then, 


r("-V  ’ It  f ii.p]*‘t<N>hi 


(N), 


j G(exp( j (N-l)  ^)) 

(48) 

(49) 

(50) 


(51) 


Proof 


From  (35),  it  follows  that 


b (N.S  ) = 1, 
r , s 1 


V(r,s)  ( SNxSN- 


Therefore,  (39)  becomes 

TtN.S^  - H*(N)H(N)  = [1(  fl  p]h*(N)h1(N) 


□ 


As  for  the  general  case  ,rf  c » the  following  general  properties  of 

r(N,.5F)  can  be  usefully  pointed  out. 

Theorem  6 


Let 


p = [hf  sN  rank  tG(exP<Jh  ^)>J5 
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then 


rank  [r(N,//’>]  = min{p,p|  ,'f  |}, 
Proof 


.'f  c ./’(S  ) . 
N 


Letting 


j (N)  = diag[Z,Z ,Z],  ,^(N)<  RpNxpN 

'.S(N)  = diag[G(exp(jo  ^)  ) , G(exp(jl  ^) ) 


, G(exp(  j (N-l) 

(52) 


B(N , ,’f)  ± [b  ] „ , 

r , s r=U, 1 , . . . ,N-I 

s=0,l, . . . ,N-1 


.rf(N,//’)  = B(N,^)  X I , 

P 

a simple  but  cumbersome  computation  shows  that 


r(N,.y’)  = «MN)7MN).rf(N,//)  ^(N)  «(N), 

so  that 

rank  [T(N, .'✓')]  £ min{rank[  'ft  (N)  ] , rank  [•*?  (N ,.'/')]) . 

Since 

rank  [.#?( N, ,'/’)]  = p ranklBfN,//1)  ] 

(see  [21],  page  227)  and 

B(N,//>)  = -±-  l B*(k)  B(k)  , 

| !f  | K ( 

where 

B(k)  = [exp(jkO  ~)  exp(jkl  ^)  ...  exp(jk(N-l)  ~)  ] , 

then,  if  ^»(S  ), 
n 

rank  [,^  (N,  If)  ] * p|.'/’| 
and  the  theorem  follows. 
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Corollary  2 

If  N > np  | ,cf  | , then 

rank  [r(N,//)J  < p\ &\ , ,</>  c . 

Proof 

Since,  by  assumption,  G(z)  is  not  identically  equal  to  zero,  there  is  at 
least  one  of  its  elements  which  can  be  zero  at  most  in  n-1  points  of  the 
complex  plane.  Therefore, 

Ih  ( [0,n-l]  ranktG(exP(Jh  1 1 

Proposition  3 

The  trace  of  ?('$,//’)  is  the  same  for  all  !f  ( 

Proof 

The  proof  is  trivially  obtained  by  noticing  that,  for  each  r C , 

n (N , //’)  = n (exp ( jr  %),  V.^(,y>(S  ). 

r , r N n 

5.  JOINT  OPTIMAL  INPUT  AND  MEASUREMENT  SCHEDULE  DESIGN 

The  key  result  for  the  solution  of  Problem  D in  the  simplest  case  of 
linear  system  affected  by  a scalar  parameter  is  supplied  by  the  following 
theorem. 

Theorem  7 

For  each  ,(f  ( .l^(S^)  , the  maximum  eigenvalue  of  T (N , ,'jP ) satisfies  the  follow- 
ing inequalities 


— max  ||h.(N)||  <X  [T(N,//?)]<A  [£  h*(N)h(N)], 

:f  | i=i 1 max  max  it  [l,p] 


(53) 


where  h^(N)  is  defined  as  in  Theorem  5. 


J 
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Proof 

Letting 

T(N,k)  = diag[exp(jkO  ~)  , exp(jkl  ~) , ....  exp(jk(N-l)  -^)  ] 
.y'(N.k)  = T(N,k)  X I 

m 

v(N,k,i)  = h^N)  ./-(N.k)  , 
f'(N,,y’)  can  be  given  the  following  form 


T(N, 

which,  in  turn,  implies  that 


= l\n<S  ^i  C [l,p]  v*(N.k>i)v(N>k>i)  . 


Xm,Jr<N-^)l  = 

max 


max 

Ull-i 


l £*./'*  (N,k) 
k i.'/1 


I 


if  fl.P) 


h*(N)h  (N) 


•/(N,k)C 


(54) 

For  each  k ( S , .^(N.k)  is  an  orthogonal  matrix.  Hence,  if  (|f||  = 1, 

N iiii 


£*  ,y(N ,k) 

l h* (N)h  (N) 

* r i i 1 L 

.#(N,k)£  < A 

— max 

Y h*(N)h  (N) 

i ( [l.p] 

i ( [l.p]  1 

(55) 


for  all  k ( S. 


From  (54)  and  (55),  the  right  hand  inequality  in  statement  (53)  follows, 
while  the  left  hand  side  is  an  easy  consequence  of  (54). 


Remark  2 

When  //’ ( .j?(  ^ ) , Theorem  7 yields  interesting  bounds  for.  H 1 (N,  .'/',0,u  (•)), 

o 

namely  the  Frechet-Cramer-Rao  approximate  covariance  lower  bound.  More 
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precisely,  assuming,  without  any  loss  of  generality,  that  •'?  = W ns«, 

1 N 

(14),  (31)  and  (53)  imply  that 

1-1 


:/ 


L r i ,h*(N)h.(N) 
Lt  t [l.Pl  i i 


1(N,./,9,uo(.)) 


3P 


max 


i 1 ♦ • • • * p 


|ht(N) 


-1 


Corollary  3 

4> 

For  each  period  N C y,  the  optimal  measurement  schedule  //’.  is  a singleton 
up  to  time  delays,  the  solution  of  Problem  D is  precisely  given  by 


il 

r*~> 

o 

(56) 

u^(- ) = u°(N,S^ , . ) . 

(57) 

Proof 

Theorems  5 and  7 imply  that  (56),  (57)  is  a solution  of  Problem  D.  On  the 

other  hand,  in  view  of  the  invariance  of  system  (7)-(9)  and  of  the  form 

of  constraints  (12),  (13),  the  set  { h } , he  S , and  the  control 

N 

u(k)  = u°(N,S^,k-h)  is  a solution  of  Problem  D too. 

Renta  rk  3 

In  the  case  of  single  input-single  output  system.  Corollary  3 is  a trivial 
consequence  of  Theorem  6 and  Proposition  3. 
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Remark  4 

Obviously,  in  view  of  Theorem  1,  a solution  r>l  Problem  D is  given  by  (56) 
and  the  periodic  extension  of  (57). 

Remark  5 

The  peculiar  form  of  (56)  enables  one  to  solve  Problem  C for  any  measurement 
schedule  set  ff  f of  a given  cordinality  • As  a matter  of  fact, 

it  is  apparent  that  the  choice 

fSi  = {0.N.2N,  ....  (v-l)N} 

u^(.)  = PE[uV)], 

where  PE [ . ] denotes  periodic  extension,  reults  in  a maximal  "information" 
for  parameter  identification.  Correspondingly,  the  minimum  parameter 
estimators  variance  is  given  by 

- {A  [L  , „ i h* (N)h  (N)  ] }-1 
v max  u i < [ 1 , p ] i i 

Note  that  such  a strong  conclusion  cannot  be  drawn  in  the  general  case. 

6.  OPTIMAL  PERIOD  DESIGN 

As  far  as  the  period  design  is  concerned,  the  cases  .l/>=S^  and.!/’=S^ 
are  here  discussed. 

With  reference  to  definition  (45),  denote  by  X(a)  the  maximum  eigen- 
value of  n(exp(ja)),  a r[0,2*],  and  by  V(a)  a unitary  norm  eigenvalue 
of  n(exp(ja))  correspodning  to  X(a).  Observe  that  the  continuity  of  the 
function  X(.)  implies  that  there  exists  a° < [0,2n]  such  that 
X (a°)  > X (a) , V a ( [0,2*}. 

Then,  the  following  result  can  be  stated. 
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Theorem  8 
Let  .S'7-  S^. 

If  a0/2iT  is  a rational  number,  so  that  there  exist  two  intergers  a° 

and  N°  such  that 

o o 
a a 

2*  = N°  ’ 

then  a solution  of  Problem  B is  given  by 


N®  = N° 


u*(k)  = u°(N°,SN0.k) 


Jl  Re{V(a°)exp(jka°  — ) } 


a°=0. 


If  a / 2n  is  an  irrational  number,  for  each  N>0  there  exists  an  N>N 
such  that 

J(N,S{j,u°(N,S^,.))  > J(N,Sn,u°(N,Sn..)) 

and,  therefore,  the  optimal  period  does  not  exist. 

Proof 

The  first  part  of  the  theorem  immediately  follows  from  Theorem  4.  As  for 
the  second  part,  recall  that,  according  to  Theorem  4,  the  optimal  N-periodic 
control  is  given  by  a discrete-time  sinusoid  of  frequency  h°/N.  Then,  since 
a°/2n  is  an  irrational  number 


h , , o 

2*  i a , 


VN>1 . 


Therefore,  letting 


y - min{n°,  ~ 2n } 
N 


6 = max{a°,  — • 2n } , 
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in  view  of  the  continuity  of  X(*)»  It  is  possible  to  find  two  non-zero 
integers  a and  N such  that  «. 

■ c (y,6) 

N 

and 

X(~  2n)  - J(N,Sn,u°(N,Sn,.))  < J(N,S',G(.))  < X(a°), 
where 

u(k)  = yfl  Re 

Theorem  9 
Let  //=  Sj  . 

Then,  for  each  N>1,  there  exist  an  integer  N>N  such  that 
J(N,S1,u°(N,S1,.))  > J(H,S1,»°(M,S1,.)); 

hence,  the  optimal  period  does  not  exist. 

Proof 

With  reference  to  Theorem  5,  it  is 

J(N,S1,u°(N,S1..))  - >max^l  t [1,p]h*<N)hi<N>1 

> max  IlhjlN)!!2  (58) 

i=l , • • * »P 

Now,  from  (50)  it  follows  that 

h (II)  = si*(M), 

where  z^  is  the  i-th  row  of  matrix  (49)  and  4>(N)  has  been  defined  in  (48). 

Since  Zj  must  be  non-zero  and  there  exists  at  least  one  element  of  the  transfer 


V(r  2n)  exp(jka-r)  . 
N N 


matrix  G(z)  which  may  be  zero  in  at  most  n-1  points,  there  exists  a r such  that 
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1 |h1(rN) J | 2 > |!h1(N)||2,  Vi  ( [l.p]  (58) 

From  (58)  and  (59),  the  statement  follows. 

□ 

Theorems  8 and  9 show  that  the  performance  index  admits  a maximum  with  re- 
spect to  N neither  if  if  = S„  and  a°/2tt  is  irrational  nor  if  . How- 

N 1 

ever,  only  in  the  latter  of  these  two  cases  the  suprumum  of  the  per- 
formance index  takes  on  an  infinite  value;  precisely,  the  following  result 
can  be  stated. 

Theorem  10 

The  suprepum  of  the  performance  index  J(N,  .!/’,u°(N,  //',  ■ ))  with  respect  to  the 
period  N is  given  by 

sup  J(N,S  u°(N,S  ,•))  = A(a°)  (60) 

N>1 

for  .y’=S  and  by 
N 

sup  J(N,S  ,u°(N,S  ,.))  = +°°  (61) 

N>1 

for  SL- 
Proof 

Formula  (60)  can  easily  be  derived  from  the  proof  of  Theorem  8. 

As  for  (61),  observe  first  that 

sup  J(N,S1,u°(N,S1,.))  « lim  J(N,S  ,u°(N,S1,.)) 

N>1 

- lim  A [ 4>* (N) R-14>(N)  ] 

N-+oo  max 

(See  Theorems  5 and  9.)  Since  R is  a positive  definite  matrix,  (61)  i9 
proved  by  showing  that 


lim  A l<t>*(N)4>(N)]  =*  . 

vi  max 


(62) 
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With  this  aim,  denote  by  $^(N),  the  i-th  row  of  4>(N). 
From  the  identity 


**(N)#(N)  = (1  j 4>* (N) (^t (N)  , 

it  follows  that 

X [4>*(N)*(N)1  > | 1 | |2,  Vi  ( [ 1 ,p]  • (63) 

in3X  l 

Let  now  t,  t f [l,p],  be  any  Integer  such  that,  for  some  integer  v{  [l,m], 
the  transfer  function  G (z)  is  not  identically  zero.  From  (48),  it 


is  apparent  that 


H\(N)I|Z  - £ktSN|Gt,v(eXp(jk  ~N))iZ  • 

Then,  consider  an  interval  [8^,82]  9 [0,2ir],  82>B^,  such  that 


(64) 


Gfc  v(exp(joO)  4 0, 


Va  ( [81,B2J 


(such  an  interval  does  obviously  exists)  and  let 


y 


»(Te>2]  • 


From  (64)  and  (65),  it  follows  that 


I Ut(N)  | |2  > y t(N) 


(65) 


(66) 


where  x(N)  is  the  cardinality  of 

[81,62]  H {0  1 ....  (N-l)  ^ } 


Finally,  since  y > 0 and 


lim 

N-»® 


N 


62-Bl 
2 ir 


(67) 


(63)  and  (66)  give  (61)  and  the  proof  is  completed. 
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Remark  6 

In  view  of  the  above  result,  an  interesting  comparison  between  the  trends 
of  the  approximate  variance  lower  bound  for  the  measurement  allocation 
sets 

SP'  = [0,  4N-1 J (68) 

SP"  = { 0 , N , 2N , ....  (^N-l)N), 

where  the  cardinality  v of  the  two  sets  is  the  same  and  is  given  by 
v = CN.can  usefully  be  pointed  out. 

If  (60)  implies  that,  either  if  N is  fixed  and  v-*=°  or  r,  is 

fixed  and  v-*»,  the  variance  lower  bound  goes  to  zero  as  1/v.  On  the 
other  hand,  definition  (18)  and  Theorems  3 and  5 enable  to  derive  that 

. ^■1(N,//’,,,9,u  (.))  * ~ {\  [ (N)  R— 1 <t>  (N)  ] }_1. 

o max 

Therefore,  the  variance  lower  bound  corresponding  to goes  to  zero  as 

1/v  for  v-*®  and  N fixed,  while,  in  view  of  (63),  (64),  (66),  and  (67),  for 

2 

v-*®  and  C fixed,  it  goes  to  zero  at  least  as  1/v  . 

□ 

For  the  sake  of  illustration  of  the  results  presented  in  Sections  4-6, 
the  simple  case  of  single  input-single  output  systems  is  now  briefly 
discussed . 

Remark  7 

Consider  a single  input-single  output  system;  in  this  case,  G(z)  is 
simply  the  nominal  sensitivity  system  transfer  function.  Suppose  that 
the  measurable  output  is  observed  for  SP  = -P'  (see  (68)).  Then 

(Theorem  4),  the  optimal  control  for  the  parameter  identification  is  given  by 
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u° (k)  = 


/ 2 cos  (kh°  ~), 
N 


where  h is  such  that 


h°*0 


h°=0. 


G(exp(jh°  ^))|  > |c(exp(jh  ^)  j , Vh  ( [0.N-1J. 


2 IT. 


The  approximate  variance  lower  bound  is  then 


.if  1 (N,  •9<M  ,0,  PE[u°(N,S  , . ) ] = 

N 


v|G(exp(jh°  ^))  '2 
R being  the  variance  of  the  additive  noise. 

If  3P  ~'f\  according  to  Theorems  3 and  5,  the  optimal  control  turns 
out  to  be 


(69) 


u°(k) 


N-l 


Ih  |G(exp(jh  -*)) 


-1/2 


N-l 


Ih  G(exp(jh  ^))  exp( jkh  — ^) 


and  the  variance  lower  bound  is  given  by 


£_1( PE[u°(N,S1  ,.)])  = 


ll  |G(exP(jh  ^))|2 


0 


(70) 


which  is  obviously  smaller  than  (69).  Finally,  it  is  apparent  that,  for  a 
fixed  r,,  (69)  and  (70)  go  to  zero,  when  v goes  to  the  infinity,  as  1/v 


and  at  least  as  1/v  respectively. 
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7 • C0NCUD1NG  REMARKS 

In  this  paper,  a number  of  problems  concerning  the  optimal  cycling  for 
parameter  identification  of  discrete-time  and  time-invariant  systems  with 
output  additive  noise  have  been  raised  and  properly  stated  as  Periodic 
Optimization  Problems.  As  it  is  natural  to  expect,  explicit  solutions  are 
given  for  linear  systems  only,  affected  by  a scalar  parameter. 

The  results  reported  in  the  present  paper  leave  a number  of  interest- 
ing questions  open  for  further  research;  among  them,  the  extension  to  the 
multiparameter  case  and/or  to  problems  characterized  by  non-integral  con- 
trol constraints  of  the  results  given  in  Sections  4 - 6 as  well  as  the  same 
analysis  for  systems  affected  by  additive  noise  not  only  on  the  output 
equation  but  on  the  state  equation  too  seem  to  be  the  most  challenging 
ones . 
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